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B NONFULLTEXT 

>>> 77 does not exist 

>>>1 of the specified files is not available 

23jun03 09:30:29 User268077 Session D88.3 

$0.26 0.047 DialUnits File9 
$0.26 Estimated cost File9 

$0.41 0.413 DialUnits File20 
$0.41 Estimated cost File20 

$0.04 0.041 DialUnits File476 
$0.04 Estimated cost File476 

$0.06 0.057 DialUnits File610 
$0.06 Estimated cost File610 

$0.04 0.038 DialUnits File613 
$0.04 Estimated cost File613 

$0.14 0.024 DialUnits File624 
$0.14 Estimated cost File624 

$0.03 0.031 DialUnits File634 
$0.03 Estimated cost File634 

$0.31 0.058 DialUnits File636 
$0.31 Estimated cost File636 

$0.04 0.035 DialUnits File810 
$0.04 Estimated cost File810 

$0.04 0.045 DialUnits File813 
$0.04 Estimated cost File813 

OneSearch, 10 files, 0.789 DialUnits FileOS 
$0 .46 INTERNET 

$1.83 Estimated cost this search 
$11.83 Estimated total session cost 1.883 DialUnits 




SYSTEM: OS . - DIALOG OneSearch 

File 2:INSPEC 1969-2003/Jun W3 

(c) 2003 Institution of Electrical Engineers 
*File 2: Alert feature enhanced for multiple files, duplicates 
removal, customized scheduling. See HELP ALERT. 
File 35 :Dissertation Abs Online 1861-2003/May 

(c) 2 003 ProQuest Inf o&Learning 
File 65: Inside Conferences 1993 -2003/ Jun W3 

(c) 2003 BLDSC all rts . reserv. 
File 99:Wilson Appl . Sci & Tech Abs 1983-2003/May 

(c) 2003 The HW Wilson Co. 
File 233: Internet & Personal Comp. Abs. 1981-2003/May 

(c) 2 003 Info. Today Inc. 
File 256 : SoftBase : Reviews , Companies&Prods . 82 -2 003 /May 

{c)2003 Info. Sources Inc 
File 474:New York Times Abs 1969-2003/ Jun 20 

(c) 2003 The New York Times 
File 475: Wall Street Journal Abs 1973 -2003/ Jun 20 

(c) 2 003 The New York Times 
File 583:Gale Group Globalbase (TM) 1986-2002/Dec 13 

(c) 2002 The Gale Group 
*File 583: This file is no longer updating as of 12-13-2002. 



Set Items Description 



S BREADTH (W) FIRST (W) SEARCH 
3 6912 BREADTH 
1466203 FIRST 
178544 SEARCH 
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SI 425 BREADTH (W) FIRST (W) SEARCH 



S SI AND RATING 

425 SI 

59903 RATING 

S2 2 SI AND RATING 



RD S2 

. . . completed examining records 

S3 2 RD S2 (unique items) 



T S3/3,K/ALL 

3/3, K/l (Item 1 from file: 2) 

DIALOG (R) File 2 : INSPEC 

(c) 2003 Institution of Electrical Engineers. All rts . reserv. 

5685034 INSPEC Abstract Number: C9710-3390M-190 
Title: Generating and evaluating regrasp operations 

Author (s) : Rohrdanz, F. ; Wahl, F.M. 

Author Affiliation: Inst. for Robotics & Process Control, Tech. Univ. 
Braunschweig, Germany 

Conference Title: Proceedings. 1997 IEEE International Conference on 
Robotics and Automation (Cat. No . 97CH35992 ) Part vol.3 p. 2013-18 
vol.3 

Publisher: IEEE , New York, NY, USA 

Publication Date: 1997 Country of Publication: USA 4 vol. lxiii+3620 
pp. 

ISBN: 0 7803 3612 7 Material Identity Number: XX97-01983 

U.S. Copyright Clearance Center Code: 0 7803 3612 7/97/$5.00 
Conference Title: Proceedings of International Conference on Robotics and 
Automation 

Conference Sponsor: IEEE Robotics & Autom. Soc 

Conference Date: 20-25 April 1997 Conference Location: Albuquerque, 
NM, USA 

Language: English 
Subfile: C 
Copyright 1997, IEE 

...Abstract: a robot arm equipped with a parallel-jaw end-effector. The 
method employs an evaluated breadth - first search in the space of 
compatible regrasp operations taking into account several criteria rating 
about the grasp and placement quality. We pay particular attention to 
online computational efficiency. The... 

...Identifiers: breadth - first search ; 



3/3,K/2 (Item 1 from file: 35) 

DIALOG (R) File 35 : Dissertation Abs Online 
(c) 2003 ProQuest Inf o&Learning . All rts. reserv. 

761749 ORDER NO: AAD81-26039 

AN INVESTIGATION OF THE PROBLEM SOLVING BEHAVIOR OF SYSTEMS ANALYSTS 

Author: VI TALARI , NICHOLAS PAUL 
Degree: PH.D. 
Year: 1981 

Corporate Source/Institution: UNIVERSITY OF MINNESOTA (0130) 
Source: VOLUME 42/06-A OF DISSERTATION ABSTRACTS INTERNATIONAL. 
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PAGE 2 762 



3 85 PAGES 



. . .three years of job experience in systems analysis were selected via 
an empirically validated supervisory rating instrument from nine 
Minnesota-based operations. Corporate revenues ranged from $100 million to 
$5 billion. . . 

...flexibility that was manifested in the use of strategic thinking, 
specific goals, high-level planning, breadth - first search and an 
explicit search for clues. (2) The high-rated group focused more upon the 
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L Number 


Hits 


Search Text 


DB 


Time stamp 




1145 


reputation 


i ion AT 

UbPAT 


z003/0o/23 09:02 


- 


523 


reputation and rate 


USPAT 


2002/11/18 15:34 


- 


288 


(reputation and rate) and weight 


USPAT 


2002/11/19 15:21 


- 


4 


607311 7. pn. 5768142.pn. 5732400.pn. 5550746.pn. 


USPAT 


4+\ f\ f*\ f\ t A A i A\ O A ^ ^ j 

2002/11/13 17:11 




38 


rating near (person or entity or candidate) 


USPAT 


2002/1 1/22 15:24 




1 1 


(5019961 | 5117349 | 5249262 | 5471610 | 5537586 | 


i ion a ~r 

UbPAT 


2002/1 1/14 09:50 






tic c a a n a ah i iier^onnoti i iicrconoA" i iiceno/i >i7ii l ncz? a r\ a oo'i i 

5544049 | 5563998 | 5563999 | 5608447 | 5649186 | 










5867799 ).PN. 








3608 


(rat$3 or assess$3 or evaluat$3 or valu$3) near (person or entity 


i ion a ~r 

USPAT 


OAAO/H A 1 A C Art. >l jI 

2002/1 1/15 09:44 






or candidate) 








1464 


((rat$3 or assess$3 or evaluat$3 or valu$3) near (person or entity 


i ion AT 

USPAT 


2002/1 1/14 09:57 






or candidate)) and weight 






- 


7 


(((rat$3 or assess$3 or evaluat$3 or valu$3) near (person or 


i ion AT 

USPAT 


2002/1 1/14 10:00 






entity or candidate)) and weight) and reputation 






- 


304 


(((rat$3 or assess$3 or evaluat$3 or valu$3) near (person or 


USPAT 


^\/\ ^ f\ i A A 1 A A A f\ i*\r\ 

2002/11/14 13:03 






entity or candidate)) and weight) and estimate 






■ 


288 


((((rat$3 or assess$3 or evaluat$3 or valu$3) near (person or 


USPAT 


r\f\r\n i a a Ia a a . r\ r~ 

2002/11/14 13:05 






entity or candidate)) and weight) and estimate) and first and 










second 








97 


((rat$3 or assess$3 or evaluat$3 or valu$3) near (person or entity 


USPAT 


2002/11/22 10:33 






or candidate)) and 705/$.cor. 








733 


((rat$3 or assess$3 or evaluat$3 or valu$3) near (person or 


USPAT 


4f\ /\ ^\ f\ i A A /A A A A J A 

2002/11/21 11:43 






system or product or entity or candidate)) and 705/$.cor. 






■ 


468 


rater 


USPAT 


2002/11/15 09:49 




3 


rater and reputation 


USPAT 


OAA1//( A IA C AA. A f\ 

2002/11/15 09:49 




51 


reputation and trust 


USPAT 


2002/11/15 17:00 


■ 


1205 


rate and trust 


USPAT 


2002/11/15 17:01 




226 


(rate and trust) and 705/$.cor. 


USPAT 


2002/11/15 17:01 


■ 


0 


(reputation and rate) and weight 


EPO; JPO; 


2002/11/18 15:34 








DERWENT; 










IBM_TDB 






3 


reputation and rate 


EPO; JPO; 


2002/11/18 15:34 








DERWENT; 










1 ^\ ft A 11^ f-^\ 

IBM_TDB 




■ 


63 


reputation 


EPO; JPO; 


2002/11/18 15:34 








DERWENT; 










IBM_TDB 






0 


200195136. URPN. 


USPAT 


2002/11/18 15:37 




0 


o a a 4 act a h a i innki 

2001 9521 0.URPN. 


USPAT 


f\f\i*i.f\ 1 A A 1 A f\ A P^ - A f\ 

2002/11/18 15:40 




0 


2001 95211. URPN. 


USPAT 


2002/11/18 15:37 




0 


2001 9521 2. URPN. 


USPAT 


2002/11/18 15:37 




0 


2001 9521 3. URPN. 


USPAT 


2002/11/18 15:37 




146 


(reputation and rate) and weight and average 


USPAT 


2002/11/19 15:47 




15 


/II A f\ A A d*\ A II 1 Iff ^ t m \/ m \/ m \/ m \ ,4 /"\M 1 11 V"V #"\ J a f\ A\ t% 1 ll^AJJ A^/Ml 1 II ^ A A f\. A ^ f\ It 1 

(4914694 | 4996642" | 5034981" | "5041972" | "5446159 | 


USPAT 


2002/11/20 13:20 






5446891 | '5544161 | 5583763 | 5692107 | 5699507 | 










ii^ a r\ a th I nn Jftp iAn I MMonpftAH I hi- taa a a/mi i »r A^AAr/\nv nil 

5704017 j 5740549 | 5768592 | 5790426 | 5872850 ).PN. 








30 


("3952184" | "4041617" | "4205464" | "4331973" | "4348740" | 


USPAT 


2002/11/20 13:51 






4546382 | 4566030 | 4602279 | 4627818 | 4630108 | 










4646145 | 4647964 | 4658290 | 4682956 | 4745549 | 










4781596 I 4870579 | 4872113 | 4914694 | 4996642 | 










"5034981" j "5041972" j "5446159" j "5446891" j "5459306" j 










"5544161" | "5583763" j "5692107" j "5699507" j "570401 7"). PN. 








15 


("4870579" | "4908758" | "4914684" | "4996642" | "5034981" | 


USPAT 


2002/11/20 13:59 






"5041972" | "512491 1" | "5446159" | "5446891" | "5544161" | 










5583763 | 5692107 | 5699507 | 5704017 | 5774868 ).PN. 








1 1 


/uc C\ A C\t~\C? A n I MPi a ~7 O A r\w I ncOjlftOOii 1 lie A t a a am I ir r" roTrnoii 1 

(5019961 | 5117349 | 5249262 | 5471610 | 5537586 | 


USPAT 


2002/11/20 14:02 






5544049 J 5563998 | 5563999 | 5608447 | 5649186 | 










HCO rt 77ftrtll\ PiKI 

5867799 ).PN. 






— 


2 


(reputation or qualification or eligibility or expertise) near 


USPAT 


2002/11/21 11:47 






(reviewer or rater or recommender) 








13 


(reputation or rating or qualification or eligibility or expertise) near 


USPAT 


2002/11/21 11:47 






1 m \ ilmttn* /~\ r» rotor r rAf*f\rm*m e^nri 

^reviewer or rater or recommenaer^ 








14 


("4870579" | "4989141" | "4996642" | "5006998" | "5132899" | 


USPAT 


2002/11/21 12:54 






"5262941" | "53831 1 1" | "5414838" | "5502637" | "5583763" | 










"5812988" | "5819271" j "5893079" | "5897639").PN. 








3 


("4870579" | "4996642" | "545241 0").PN. 


USPAT 


2002/11/21 16:16 
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- 


6 


("4870579" | "4996642" | "5530853" | ,, 5559949 M | "5676138" | 


USPAT 


2002/11/21 16:21 






"5684951 M ).PN. 






- 


6 


(4870579 | 4996642 | 5530853 | 5559949 | 5676138 | 


USPAT 


2002/11/21 16:21 






"5684951 ").PN. 






- 


2918 


rating adj system 


USPAT; 


2002/11/22 14:32 








US-PGPUB 




- 


42 


(rating adj system) and (reputation) 


USPAT; 


2002/11/22 10:44 








US-PGPUB 




- 


1760 


scoring adj system 


USPAT; 


2002/11/22 14:32 








US-PGPUB 




- 


6 


(scoring adj system) and reputation 


USPAT; 


2002/11/22 14:36 








US-PGPUB 




- 


51 


scoring and reputation 


USPAT; 


2002/11/22 14:36 








US-PGPUB 




■ 


2 


4, 870,579. pn. or 4,996,642. pn. 


USPAT 


2002/11/22 15:45 


■ 


2 


( 4870579 | 4872113 ).PN. 


USPAT 


2002/11/22 15:41 


- 


88 


4996642. URPN. 


USPAT 


2002/11/22 15:41 


- 


401 


product adj evaluation 


USPAT 


2002/11/22 15:46 


- 


1 


(product adj evaluation) and reputation 


USPAT 


2002/11/22 15:46 


- 


6 


average near user near rating 


USPAT 


2002/11/25 10:26 


- 


12 


("5659732" | "5742768" | "5864871" | "5872850" | "5895470" | 


USPAT 


2002/11/25 10:12 






"5905988" | "5911043" | "5913215" | "5918014" | "5943670" | 










"5961591" j "597441 2").PN. 






- 


1 


(reputation or expertise or qualification) and (average near user 


USPAT 


2002/11/25 10:28 






near rating) 






- 


28 


(reputation or expertise or qualification) and (average near rating) 


USPAT 


2002/11/25 11:22 


- 


111 


rating and diaz 


USPAT 


2002/11/25 11:23 


■ 


11 


rating and diaz and susanna 


USPAT 


2002/11/25 11:46 


■ 


2 


4996642. pn. 4870579.pn. 


USPAT 


2002/11/25 11:46 




1 


6,347,332.pn. 


USPAT; 


2002/11/26 14:48 








US-PGPUB 






9 


rating near path 


USPAT 


2002/12/02 15:46 




534 


breadth adj first 


USPAT 


2003/06/23 09:02 




10 


(breadth adj first) and rating 


USPAT 


2003/06/23 09:03 
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Your Recent Searches 



Page 1 of 1 



C^Pt0QU0$t* > Return to NPL Web Page Text Version [English 

IBBBBB 



i 




?Help 



fry (SooKI© 



Searching collections: All Collections 



Recent Searches 



Following is a list of your searches for this session. They are presented from most current to oldest. 
Number Search 

2 breadth first search AND PDN(<1 1/10/1999) View 1 1 results Add to Search 

1 breadth first rating AND PDN(<1 1/10/1999) View 1 1 results Add to Search 



Enter a word, words or specific phrase. 



breadth first search AND PDN(<1 1/10/1999) 



Publication 
type: 

Search in: 



[aiT 



E 



Article text 



s 



E Show results with full text availability only 

□ Show articles from peer reviewed publications only 

□ Show total number of articles 



Copyright © 2003 ProQuest Information and Learning Company. All rights reserved 

Terms and Conditions 
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Welcome to DialogClassic Web(tm) 

*** DIALOG HOMEBASE (SM) Main Menu *** 

Information : 

1. Announcements (new files, reloads, etc.) 

2. Database, Rates, & Command Descriptions 

3. Help in Choosing Databases for Your Topic 

4. Customer Services (telephone assistance, training, seminars, etc.) 

5 . Product Descriptions 

Connections : 

6. DIALOG (R) Document Delivery 

7. Data Star(R) 

(c) 2000 The Dialog Corporation pic All rights reserved. 

/H = Help /L = Logoff /NOMENU = Command Mode 



Enter an option number to view information or to connect to an online 
service. Enter a BEGIN command plus a file number to search a database 
(e.g. , Bl for ERIC) . 



B FULLTEXT1 

23jun03 09:22:21 User268077 Session D88.1 
$0.00 0.140 DialUnits FileHomeBase 
$0.00 Estimated cost FileHomeBase 
$0.03 INTERNET 

$0.03 Estimated cost this search 

$0.03 Estimated total session cost 0.140 DialUnits 

SYSTEM: OS - DIALOG OneSearch 

File 15 :ABl/lnform(R) 1971-2003/ Jun 21 
(c) 2003 ProQuest Inf o&Learning 
*File 15: Alert feature enhanced for multiple files, duplicate 
removal, customized scheduling. See HELP ALERT. 
File 16:Gale Group PROMT (R) 1990 -2003/ Jun 20 
(c) 2 003 The Gale Group 
*File 16: Alert feature enhanced for multiple files, duplicate 
removal, customized scheduling. See HELP ALERT. 

File 148:Gale Group Trade & Industry DB 1976-2 003/ Jun 19 
(c)2003 The Gale Group 
♦File 148: Alert feature enhanced for multiple files, duplicate 
removal, customized scheduling. See HELP ALERT. 
File 160:Gale Group PROMT (R) 1972-1989 

(c) 1999 The Gale Group 
File 275:Gale Group Computer DB (TM) 1983 -2003/ Jun 20 

(c) 2 003 The Gale Group 
File 621:Gale Group New Prod.Annou. (R) 1985-2003/ Jun 19 
(c) 2 0 03 The Gale Group 

Set Items Description 



S BREADTH (W) FIRST (W) SEARCH 
115748 BREADTH 
7195187 FIRST 
714444 SEARCH 
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SI 80 BREADTH (W) FIRST (W) SEARCH 



S SI AND RATING 

80 SI 

66324*2 RATING 

S2 4 SI AND RATING 



RD S2 

...completed examining records 

S3 2 RD S2 (unique items) 



T S3/3,K/ALL 

3/3, K/l (Item 1 from file: 15) 

DIALOG (R) File 15 : ABI/Inf orm (R) 

(c) 2003 ProQuest Inf o&Learning . All rts . reserv. 
00651717 93-00938 

Choosing the Correct Expert System Development Method for Financial 
Decision-Making 

Yiu, Kenneth L. K. ; Kong, Andy W. K. 

Journal of Systems Management v43nll PP : 16-19, 30-31, 37-38, 40-43 Nov 
1992 

ISSN: 0022-4839 JRNL CODE: JSM 
WORD COUNT: 7 98 8 

. . .TEXT: the system examines the rules again. 

In addition to the chaining strategy, depth-first and breadth - first 

search of a knowledge base must be distinguished. In a depth-first 
search, the inference engine ... credit granting. For financial institutions, 
there are commercial loan analyzers, credit approval system, commercial 
account rating systems, credit application systems, processing of 
administrative documents and automated teller control. For security, 
financial . . . 

... is allowed to input weighted value for factors in qualitative or 
quantitative format to determine rating and associated certainties in 
evaluation (e.g. the contribution of growth rate of assets to. . .by Chase 
Manhattan Bank is categorized under the following details: 

personal detail 

employment detail 

credit rating detail 

bank relationship detail 

loan detail 

The factors related to each of these categories can. . . 



3/3, K/2 (Item 1 from file: 148) 

DIALOG (R) File 14 8: Gale Group Trade & Industry DB 
(c)2003 The Gale Group. All rts. reserv. 
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07315439 SUPPLIER NUMBER: 16392642 (USE FORMAT 7 OR 9 FOR FULL TEXT) 

The user interface of expert systems: what recent research tells us. 

White, Frank 

Library Software Review, yl3, n2 , p91(8) 
Summer, 1994 

ISSN: 0742-5759 LANGUAGE: ENGLISH RECORD TYPE: FULLTEXT 

WORD COUNT: 53 87 LINE COUNT: 00441 

will change their solution strategies (Anzai and Simon 1979) . 
Anderson (1985) found that experts use breadth - first search 
strategies in problem solving, whereas novices tend to favor depth- first 
strategies. It has been. . .mental model of how the system works achieve 
higher scores and give a higher subjective rating of system performance 
than users who have a poor mental model. Lehner concludes: "For complex... 
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B FULLTEXT2 

23jun03 09:28:46 User268077 Session D88.2 

$0.60 0.111 DialUnits FilelS 
$1.65 1 Type(s) in Format 3 

$1.65 1 Types 
$2.25 Estimated cost FilelS 

$1.10 0.204 DialUnits Filel6 
$1.10 Estimated cost Filel6 

$1.85 0.342 DialUnits Filel48 
$1.55 1 Type(s) in Format 3 

$1.55 1 Types 
$3.40 Estimated cost Filel48 

$0.10 0.019 DialUnits Filel60 
$0.10 Estimated cost Filel60 

$0.29 0.054 DialUnits File275 
$0.29 Estimated cost File275 

$1.21 0.225 DialUnits File621 
$1.21 Estimated cost File621 

OneSearch, 6 files, 0.954 DialUnits FileOS 
$1.62 INTERNET 

$9.97 Estimated cost this search 
$10.00 Estimated total session cost 1.094 DialUnits 
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SYSTEM: OS - DIALOG OneSearch 

File 9:Business & Industry (R) Jul/1994 -2003/ Jun 20 

(c) 2003 Resp. DB Svcs. 
File 20:Dialog Global Reporter 1997 -2003/ Jun 23 

(c) 2003 The Dialog Corp. 
File 476 :Financial Times Fulltext 1982 -2003/ Jun 23 

(c) 2003 Financial Times Ltd 
File 610:Business Wire 1999 -2003/ Jun 20 
(c) 2003 Business Wire. 
*File 610: File 610 now contains data from 3/9 9 forward. 
Archive data (1986-2/99) is available in File 810. 
File 613 :PR Newswire 1999-2 003/ Jun 23 

(c) 2003 PR Newswire Association Inc 
*File 613: File 613 now contains data from 5/99 forward- 
Archive data (1987-4/99) is available in File 813. 
File 624 :McGraw-Hill Publications 1985 -2003/ Jun 20 
(c) 2003 McGraw-Hill Co. Inc 
♦File 6 24: Homeland Security & Defense and 9 Piatt energy journals added 
Please see HELP NEWS624 for more 

File 634:San Jose Mercury Jun 1985 -2003/ Jun 20 

(c) 2003 San Jose Mercury News 
File 636:Gale Group Newsletter DB(TM) 1987 -2003/ Jun 18 

(c) 2003 The Gale Group 
File 810:Business Wire 1986 - 1999/Feb 28 

(c) 1999 Business Wire 
File 813 :PR Newswire 1987 -1999/Apr 30 

(c) 1999 PR Newswire Association Inc 



Set Items Description 



S BREADTH (W) FIRST (W) SEARCH 
98317 BREADTH 
10637475 FIRST 
790248 SEARCH 
SI 0 BREADTH (W) FIRST (W) SEARCH 
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T S4/3,K/ALL 

4/3,K/l (Item 1 from file: 15) 

DIALOG (R) File 15 : ABI/Inf orm (R) 

(c) 2 003 ProQuest Inf o&Learning . All rts . reserv. 
01702723 03-53713 

Differences between novice and expert systems analysts: What do we know and 
what do we do? 

Schenk, K D; Vi talari, Nicholas P; Davis, K Shannon 

Journal of Management Information Systems: JMIS vl5nl PP: 9-50 Summer 
1998 

ISSN: 0742-1222 JRNL CODE: JMI 
WORD COUNT: 15423 

...TEXT: rated based on two different indicators of analyst performance. 
First, the analysts' supervisors used a rating scale developed by Arvey 
and Hoyle [3] . This rating instrument has been used to provide a standard 
performance measure across subjects and raters in. . . 

... supervisors, identifying the highest- and lowest-rated performers in 
each organization, completed a ten-point rating scale. Both rating 
measures agreed in all cases. Based on these two measures, the high- and 
low-rated. . . 

. . . wholesale distribution. There was no significant correlation between 

number of years of experience and supervisor rating (r = 0.116). 

Task 

Subjects participated in a problem- solving task similar to those performed 
... weak methods while performing debugging tasks. Novice programmers took 
longer to debug programs, employed a breadth - first approach, and did 
not formulate an overall program structure model. This combination of using 
a... Arvey, R.D., and Hoyle, J.C. A Cuttman approach to the development of 
behavioral lybased rating scales for systems analysts and programmer 
analysts. Journal of Applied Psychology, 59, 1 (February 1974... 



4/3, K/2 (Item 2 from file: 15) 

DIALOG (R) File 15 : ABI/ Inf orm (R) 

(c) 2003 ProQuest Inf o&Learning . All rts. reserv. 
01257442 99-06838 

Cool tools for Web searching: An update 

Courtois, Martin P 

Online v20n3 PP: 29-36 May/Jun 1996 
ISSN: 0146-5422 JRNL CODE: ONL 
WORD COUNT: 4044 

. . .TEXT: Presentation: Including beauty, color, and use of video and 
graphics . 

(3) Experience: Point's key rating which covers intangibles such as 
whether the site is "fun" or worth the time, and. . .an excellent job of 
identifying major WWW resources. This is due largely to WebCrawler's " 
breadth - first " approach to finding and indexing WWW pages, which tracks 
only the first few links rather. . . 
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. . .TEXT: the system examines the rules again. 

In addition to the chaining strategy, depth-first and breadth - first 
search of a knowledge base must be distinguished. In a depth- first search, 
the inference... credit granting. For financial institutions, there are 
commercial loan analyzers, credit approval system, commercial account 
rating systems, credit application systems, processing of administrative 
documents and automated teller control. For security, financial... 

... is allowed to input weighted value for factors in qualitative or 
quantitative format to determine rating and associated certainties in 
evaluation (e.g. the contribution of growth rate of assets to. . .by Chase 
Manhattan Bank is categorized under the following details: 

personal detail 

employment detail 

credit rating detail 

bank relationship detail 

loan detail 

The factors related to each of these categories can. . . 
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will change their solution strategies (Anzai and Simon 1979) . 
Anderson (1985) found that experts use breadth - first search strategies 
in problem solving, whereas novices tend to favor depth-first strategies. 
It has . . . 

...queries. Depth-first searches, which provided immediate feedback, were 
far more pleasing to users than breadth - first searches, which provided 
no feedback until all possibilities were examined. In tracing the 
development of... mental model of how the system works achieve higher scores 
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and give a higher subjective rating of system performance than users who 
have a poor mental model. Lehner concludes: "For complex... 
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(57) ABSTRACT 

A rating of a plurality of ratings is predicted. The rating is 
associated with a user of a plurality of users and the rating 
corresponds to an item of a plurality of items. One of the 
plurality of ratings, corresponding to at least one of the 
plurality of items, is provided for each of the plurality of 
users. A predictability relation between ones of the plurality 
of users and other ones of the plurality of users is calculated 
based on ratings provided by users. One of a plurality of 
nodes is assigned to each of the plurality of users. Ones of 
the plurality of nodes are connected with other ones of the 
plurality of nodes by a plurality of edges based on the 
predictability relation. A graph which includes the plurality 
of nodes and the plurality of edges is searched for a path 
from a node assigned to the user of the plurality of users to 
another node assigned to another user of the plurality of 
users. The rating of the plurality of ratings associated with 
the user of a plurality of users is calculated based on the path 
and the predictability relation. If desired, a predicted rating 
may be produced for identifying products and customers in 
an e-commerce applications. 

22 Claims, 9 Drawing Sheets 
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SYSTEM AND METHOD FOR 
COLLABORATIVE FILTERING WITH 
APPLICATIONS TO E-COMMERCE 

5 

FIELD OF THE INVENTION 

The present invention relates generally to making a pre- 
diction about a user based on data provided in association 
with other users. In particular, a rating associated with a user 
is forecasted based on a predictability graph. Furthermore, 30 
the present invention relates to an automated system and 
method for providing recommendations of items for sale in 
an e-commerce environment. 

BACKGROUND OF THE INVENTION is 

A computing environment offers an opportunity to collect 
information relating to the various preferences of users. User 
preferences may take the form of a rating which is associated 
with an item, A rating may be a quantitative measure of a 2Q 
users relative like or dislike of an item. For example, a user 
purchasing compact discs, books, or videos over the Internet 
may provide an integer, in a given range, indicating his/her 
satisfaction with a product available for sale. 

Rating information provided by a group of users may be 25 
useful for recommending items to a user. In other words, the 
preference of a user may be predicted based on ratings for 
items provided by a group of users. One user may be found 
"similar" in his preferences to other users. Users with 
"similar" ratings may be used to predict each other's pref- 30 
erences. Deducing the preferences of a given user by exam- 
ining information about the preferences of other "similar" 
users is often referred to as collaborative filtering. Users 
collaborate by each rating a subset of a set of items. The 
collective knowledge attained from the collaborative rating 35 
of items may then be used to make recommendations. For 
example, if, based on the collective knowledge, it is pre- 
dicted that an item would be highly rated by a user, the item 
may be recommended to the user. 

Collaborative filtering may be used to make recommen- 40 
dations to customers purchasing items for sale on the World 
Wide Web. Alternatively, collaborative filtering may be used 
to make marketing recommendation to vendors using the 
World Wide Web. In general, due to the nature of a distrib- 
uted computer environment, collaborative filtering may be 45 
used to make recommendations and/or customize prefer- 
ences of users -involved in electronic transactions or 
e-commerce. Suppose, for example, that the amount of time 
a user spends viewing a Web page is regarded as an implicit 
rating of the Web page by the user. Users with "similar" 50 
viewing habits may be detected. Based on the observed 
viewing habits of users, recommendations may be calculated 
which estimate the interest a user may take in a particular 
Web page. In this way, a Web page estimated to be of interest 
to a particular user may be recommended to the user. For 55 
instance, if a user spends much time browsing Web pages 
detailing information relating to running, a Web page giving 
a comparative study of running shoes may be recommended 
to the user. The Web page giving the comparative study of 
running shoes may be recommended based on the amount of go 
time other users, viewing running related Web pages, spend 
viewing the study. 

Several collaborative filtering engines are currently avail- 
able. A discussion of such collaborative filtering engines 
may be found, for example, in U.S. Pal. No. 4,870,579 and 65 
U.S. Pat. No. 4,996,642 both issued to John B. Hey 
(employed in collaborative filtering technology offered by 
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LikeMinds Inc.), and Upendra Shardanand and Pattie Maes 
(a founder and former director of Firefly Network, Inc.), 
"Social Information Filtering: Algorithms for Automating 
Word of Mouth," Proceedings of CHI '95, Denver, Colo., 
1995,pages 210-217. 

The technology employed by LikeMinds Inc., as dis- 
closed in U.S. Pat. Nos. 4,870,579 and 4,996,642 involves 
random sampling of users. A measure of "agreement 
strength" between a current user and the randomly sampled 
users is computed. A subset is then chosen of the randomly 
sampled users. Each member of the subset corresponds to 
either a relatively high "measurement strength" or a rela- 
tively high item coverage. Item predictions are computed 
based on a "closeness" function of pairs of ratings by 
member of the subset. 

The technology employed by Firefly Network, Inc. 
involves computing a Pearson r coefficient to measure the 
"similarity" between two users. Users who are "similar" to 
a given user are identified. Predictions are made by forming 
a weighted average of ratings provided by the "similar" 
group of users. The weighting factor used to form the 
average of ratings of items is made proportional to the 
Pearson coefficient. 

SUMMARY OF THE INVENTION 

A rating of a plurality of ratings is predicted. The rating 
is associated with a user of a plurality of users and the rating 
corresponds to an item of a plurality of items. One of the 
plurality of ratings, corresponding to at least one of the 
plurality of items, is provided for each of the plurality of 
users. A predictability relation between ones of the plurality 
of users and other ones of the plurality of users is calculated 
based on ratings provided by users. One of a plurality of 
nodes is assigned to each of the plurality of users. Ones of 
the plurality of nodes are connected with other ones of the 
plurality of nodes by a plurality of edges based on the 
predictability relation. A graph which includes the plurality 
of nodes and the plurality of edges is searched for a path 
from a node assigned to the user of the plurality of users to 
another node assigned to another user of the plurality of 
users. The rating of the plurality of ratings associated with 
the user of a plurality of users is calculated based on the path 
and the predictability relation. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The invention is best understood from the following 
detailed description when read in connection with the 
accompanying drawings. It is emphasized that, according to 
common practice, the various features of the drawings are 
not to scale. On the contrary, the dimensions of the various 
features are arbitrarily expanded or reduced for clarity. 

FIG. 1 illustrates steps in a collaborative filtering process 
in accordance with an exemplary embodiment of the present 
invention; 

FIG. 2 illustrates a process for calculating the set of users 
horted by a given user in accordance with an exemplary 
embodiment of the present invention; 

FIG. 3 illustrates a process for calculating the set of users 
who predict a given user, and the associated predictor values 
in accordance with an exemplary embodiment of the present 
invention; 

FIG. 4 is a graph of an exemplary predictability and 
horting relation in accordance with an embodiment of the 
present invention; 

FIG. 5 shows an exemplary tree structure for classifying 
Compact Discs (CDs) into categories; 
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FIGS. 6 A and 6B illustrate a method for responding to an 
"extreme" query for items in a particular category which a 
given user is predicted to like in accordance with an exem- 
plary embodiment of the present invention; 

FIG. 7 illustrates a method for responding to a "target" 
query for a list of users who are predicted to like a given item 
in accordance with an exemplary embodiment of the present 
invention; and 

FIG. 8 is a block diagram of an exemplary apparatus for 
predicting a rating, which corresponds to an item and which 
is associated with a user, over a computer network in 
accordance with an embodiment of the present invention. 

DETAILED DESCRIPTION OF THE 
INVENTION 

Horting and Predictability 

Suppose that N users are involved in a collaborative 
filtering application. Suppose further that there are K items 
which may be rated. FIG. 1 illustrates steps in a collabora- 
tive application in accordance with an exemplary embodi- 
ment of the present invention. In step 102 each of the N users 
may provide ratings for some (but possibly none) of the K 
items. Define a binary matrix M£{0,1}^ by 



fi if 

Ho ot 



user / rated item j 
otherwise 



L horts i 2 if iR^J/lflJgF 



(1) 



where F is a predetermined value in (0,1]. Alternatively, a 
horting relation may be defined by 



i, horts i 2 if l^rvy/ft^F or I^HKjiSG 



(2) 



10 



For a pair <s,t>G{-l,+l}x{t^ 0 , . . . , t^ a } define a 
transformation on ratings by 
T^rH'r+t, 

where r£E{l, . . . , v}. For example, if t_j 0 »2 and t_ a 1 «2v are 
chosen, then 3r'e{l,. . .,v} such that t_ 1( Xr')e{l,'. . - ,v}. 
If t 1 0 =l-v and t 2 tl =v-l are chosen, then 3r"£{l, . . . , v} 
such that Tj Xr")E{l, . . . , v}. A predictability relation may 
be defined by 
i 2 predicts i a if 

(i) i a horts i,; 

(ii) 3<s,t>e{-l,+l}x{t :f 0 , . . . , t^} such that 



Define the set 

i?Hje{i,...,x}.-M iJ =i}. 

Thus, the set R, is a set indicating all items rated by the \ th 
user. Note that the cardinality of the set R,., namely |Rj- 
ZyM^, is the row sum for the i th row. The number of users 
who have rated an item j may be expressed by the column 
sum 2 f M^. 

A user may rate an item by providing a corresponding 
integer in a given range. If the i user rated the j** item, i.e. 
M f —1, the rating may be denoted by ^-={1, . . . , v}. For 
example, a so-called seven point scale, i.e. v«7, is com- 
monly used. A so-called thirteen point scale, i.e. v=13, is 
also commonly used, though there is evidence to support the 
notion that ratings r I(/ - varying between 1 and 7 provide users 
with a sufficiently discriminating scale (see Shardanand and 
Maes Supra). Note that odd values of V allow a user to 
express neutrality, while even values of V may force a user 
to express a positive or negative opinion. 

In the following two relations, horting and predictability, 
will be defined on a set of users. Let ij and i 2 indicate two 
users of a set of users. 



35 



where G is a predetermined threshold. Note that horting is 
reflexive but is neither symmetric nor transitive. Thus, the 
terminology i x horts i 2 is employed, but not the term cohorts. 
The terminology horts i 2 expresses the notion that suffi- 
ciently many jointly rated items exist between user i 2 and 
user i 2 , from user ij 's perspective, to decide whether user i 2 
predicts user i : in some sense. A calculation to decide 
whether user i 2 predicts user i 3 will be given below. 



S i 



20 



where U is a predetermined threshold. D^ij, i 2 ) 
represents a measure of distance between the ratings 
of user i x and the (T S J) transformed ratings of user i 2 , 
on the set of items rated by both users, normalized by 
the cardinality of the set of items rated by both users. 
For example, if 0 (ii, i^)=0 then user i 2 behaves 
identically to user i l9 and if D lj(1 (i lf i 2 )=0 then user 
25 i 1 consistently rates items one unit higher than user 

i 2 . If D_ ± v+1 (i l7 then user ^ behaves identically 
opposite to user i 1 . 
In step 104 a predictability relation between users may be 
calculated. Note that the predictability relation as defined 
30 above is reflexive, but is neither symmetric nor transitive. 
Let H ( - denote the set of users who are horted by user ij. Let 
P, denote the set of user who predict user i 3 . Therefore, by 
definition, P ( - 532H,- . In other words, in order to calculate 
predictability (according to the above definition) horting 
may be calculated first. 

Assume the variable USER1 is set to a given user. FIG. 2 
illustrates a recipe for calculating H USER1 . I q ste P 202 the 
variable USER2 may be set to the first user of N users. In 
step 204 an item index J may be set to 1, and two counters 
COUNT1 and COUNT2 may be set to 0. COUNT1 counts 
40 the number of items found that have been rated by USER1, 
While COUNT2 counts the number of items found that have 
been rated by both USER1 and USER2. 

Let ITEMj denote the set of users who rated the 1 th item. 
Suppose that the sets ITEM^ l^l^K, are sorted such that 
45 lITEMjt =• . • ^|ITEM X |. The sets ITEM 1 may be accessed 
using inverted indexes. For a discussion of inverted indexes 
see, for example, C. Faloutsos, 'Access Methods for Text/ 
ACM Computing Surveys, Vol. 17, No. 1, pp. 50-74, 1985, 
incorporated by reference herein in its entirety. In step 206 
50 a search, such as, for example, a binary (logarithmic) search 
may be made to determine if USERlQTEMy, i.e. a deter- 
mination is made whether USER1 rated item J. As the sets 
ITEM a , l^l^K, are sorted the sets with lowest cardinality 
may be searched first to determine if USERIGITEM^. If the 
55 question of whether USER2eH asE/il , i.e. whether USER1 
horts USER2, may be determined "early" in the process, i.e. 
for low values of J. the ("later") largest sets ITEM1 may not 
be searched. Thus, it may be advantageous to sort the set 
ITEM A , l^l^K in order of increasing cardinality. It may 
60 also be advantageous to sort each set ITEM 3 (the set of users 
who rated the 1 th item) in order of increasing users, i.e. 
ITEMi may be stored as an ordered set . . . , l m }, where 
li = l 2 = . . ^l m . Sorting each set ITEMj in order of 
increasing users may increase the efficiency of a search, as 
65 it makes a binary search, for example, possible. 

If USERlSTEMj. then in step 208 the variable COUNT! 
may be incremented, i.e. COUNT! may be reset to 
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C0UNT1+1. If USERlerTEM, then in step 218 the vari- 
able J may be incremented and a search for the next user may 
be reinitiated in step 206. In step 210 a search, such as, for 
example, a binary (logarithmic) search may be made to 
determine if USER2EITEM,, i.e. a determination is made 
whether USER2 rated item J. If USER2 ElTEM y then the 
variable COUNT2 may be incremented in step 212. In step 
214 it is determined whether COUNT2^T, where T«min 
(F IR^J, G) 

If it is determined in step 214 that COUNT2^T, then in 
step 216 it may be reported that USERl horts USER2, i.e. 
USER2eR t/5M1 . Once a determination is made that 
USEI&ER^^^, the process of FIG. 2 may be reset for the 
next user. Thus, in step 226 USER2 may be incremented, 
and provided that a determination is made in step 228 that 
not all users have yet been searched (i.e. USER2^N) then 
the process may be reset to step 204. Once all users have 
been searched the process may terminate in step 230. 

If it is determined in step 210 that USER2eiTEM / , then 
in step 222 a determination is made whether there may be a 
need to continue searching, i.e. whether given that 
USER2? ITEMy it may still be possible that USERl horts 
USER2. In other words, if it is determined in step 222 that 
COUNT2+|R^ 7?1 |-COUNTl<f then in step 224 it may be 
reported that USERl does not hort USER2, i.e. 
USER2gR Lr , S £ R1 . Once a determination is made that 
USER2$Rh S£ ju, the process may be reset for the next user. 
Thus, in step 226 USER2 may be incremented, and provided 
that a determination is made in step 228 that not all users 
have yet been searched (i.e. USER2^N) then the process 
may be reset to step 204. Once all users have been searched 
the process may terminate in step 230. 

If it is determined in step 222 that COUNTO+lR^^-J- 
COUNTl^T, then in step 218 the variable J may be 
incremented, and the process may be resumed for the next 
item in step 206. 

If it is determined in step 214 that COUNT2<T, then in 
step 220 a determination is made whether COUNTl= 
l R t/szr*il- If ^ is determined in step 220 that COUNTl« 
IRl/sexiI then it may be reported in step 224 that USERl 
does not hort USER2, i.e. USEI^gRys^. If, on the other 
hand, it is determined in step 220 that COUNTl^lR^^J, 
then in step 218 the variable J may be incremented. 

Although not explicitly shown in FIG. 2 it will be 
understood by one of ordinary skill in the art that as the 
relation of horting is reflexive, the process may be skipped 
for the case of USER2-USER1. . 

FIG, 3 illustrates a recipe for calculating P t/iS£K1 after 
having calculated H USER1 . Further, if USER2 predicts 
USERl then the process illustrated in FIG. 3 provides s* and 
t* such that 

D,* r (USERl,USER2)-min, f< D <ff XUSERl,USER2). 
The pair (s* ,t*) is referred to herein as the predictor values. 
In step 302 the variable s may be set to -1, and the variable 
Win may be set to *inf\ Herein, the value ( inf indicates a 
value which is larger than any other given value. In step 304 
the variable t may be set to T j0 . In step 306 D^/USERl, 
USER2) may be computed, where it may be assumed that 
USEI^GH^s^^. In step 308 a determination may be made 
whether D^/USERl,USER2)^min(U,Win). In other 
words, in step 308 a test may be performed to determine 
whether D^USER1,USER2) is the lowest value computed 
thus far by the process, and whether D s XUSER1,USER2) is 
also below the predetermined threshold U. 

If it is determined in step 308 that D 5 /USER1,USER2) 
^min(U,Win) then in step 310 the variable Win may be set 
to D Jf (USERl,USER2), Wins may be set to s, and Wint may 
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be set to t. In step 312 variable t may be incremented. In step 
314 a determination may be made whether t=t s>1 . If it is 
determined in step 314 that t=t Sfl , then the sub-process of 
steps 306, 308, 310, 312, and 314 may be repeated. If it is 

5 determined in step 314 that the value of t exceeds i lt then 
in step 316 the variable s is reset to s+2. In step 318 a 
determination may be made whether s=l. If it is determined 
in step 318 that s«l, then the sub-process of steps 304, 306, 
308, 310, 312, 314, 316, and 318 may be repeated. 

10 Otherwise, if it is determined in step 318 that s*l, then in 
step 320 a determination may be made whether the variable 
Win has taken on any value other than the maximal value 
'inP (i.e. ifWin<<inP). 
If in step 320 it is determined that Win ^'inf*, then in step 

15 322 it may be reported that USER2 predicts USERl (i.e. 
USER2eP lftS£/u ), and further that <s*,t*>-<Wins,Wint> 
are the corresponding predictor values. Hence, by applying 
the process illustrated in FIG. 3 to each elements 
USEI^GH^j^j the predictability relation V US eri mav De 

20 computed. 

Once a predictability relation V USER1 has been calculated, 
the relation may be represented by a directed graph. A graph 
includes both a set of nodes and a set of directed edges. In 
step 106 of FIG. 1 each of the N users may be assigned a 

25 node of a set of N nodes. In step 108 the set of N nodes may 
be connected by directed edges of the directed graph based 
on the predictability relation. For example, if a first node is 
assigned to USERl and a second node is assigned to 
USER2, and if USER2 predicts USERl, then a directed edge 

30 may connect the first node to the second node. Note that the 
relation of horting may also be represented by a directed 
graph. 

An exemplary graph, representing both a predictability 
and a horting relation is shown in FIG. 4, In FIG. 4 a solid 

35 directed edge between two nodes represents the relation: a 
user assigned to the destination node predicts a user assigned 
to the origin node. Further a dashed directed edge in FIG. 4 
represents the relation: a user assigned to the origin node 
horts a user assigned to the destination node. For example, 

40 as shown in FIG. 4, user 2 horts user 3 and user 5 , but user 3 and 
user s do not predict userl. Further, user 2 , user 4 , and user 6 , 
each predict user^ Note that although, trivially, each user 
both horts and predicts himselfTherself, these edges are not 
considered in this graph. ^ 

45 Suppose that a given user, say user,-, has not rated a given 
item, say item j . Suppose further that a predicted rating of 
the given item by the given user is sought. In step 110 a 
predictability graph may be searched for the 'shortest' path 
(i.e. the least number of edges) connecting between the 

50 given user and other users which rated the given item. In 
other words, a predictability graph may be searched for the 
'shortest' path connecting user t - with another user in P^^ 
who has rated item j. The graph may be searched using any 
of a variety of graph searching algorithms, such as, for 

55 example, a breadth first search. Details on shortest-path 
graph search algorithms may be found, for example, in T. 
Cormen, C. Leiserson, and R. Rivest, Introduction to 
Algorithms, MIT Press, Cambridge Mass., 1992. For 
example, in the graph shown in FIG. 4, let the given user be 

60 user,, and assume that both user 7 and user J2 rated item j. 
Both user 7 and user 12 are a distance of 2 edges from use^ 
in the graph of P^^. These two equi-length paths are the 
path from use^ to user 2 to user 7 , and the path from user 2 to 
user 4 to user 12 . 

65 In step 112 a predicted rating of item j by user,- may be 
calculated based on the * shortest' path(s) found by searching 
the graph in step 110. The predicted rating of item j may be 
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calculated by composing transformations on rating associ- rated may be partitioned into categories arranged in a 

ated with users which are assigned to nodes along the hierarchical or tree structure. The set of items associated 

'shortest' path(s) in the graph. For example, suppose a with a parent node of the tree structure is the union of the 

directed 'shortest' path may be represented by sets of items associated with child nodes of the parent node. 

5 The root node, therefore, may be associated with the entire 

. . . . h'u') set of items rated. FIG. 5 shows an exemplary tree structure 

user; ' * user^ ^ 2 jt2 K ■•■ Sq ^ » useri , of a hierarchical partition of categories for classifying Com- 
pact Discs (CDs). In FIG. 5 the root node is associated with 
a set of compact discs (CDs). The child nodes of the root 

where a prediction is sought for a rating of item j by given ^ nodes may be associated with a set of folk CDs, a set of jazz 

user user,-, user,- rates item j, and <s* 1 ,t* 1 >, . . . , <s* q ,l* q > CDs, a set of classical music CDs, a set of rock CDs, and a 

are predictor values corresponding to the path. A prediction set of soundtrack CDs. Each of these categories may in turn 

associated with such a directed path may be calculated by be subdivided into more child categories. For example, the 



.iC^.^o. • - ©^.^(r^p (3) 



15 



node associated with the set of classical CDs may have child 

nodes associated with a set of early music CDs, a set of 

The prediction sought may be given as a weighted average " romantic music CDs, a set of baroque music CDs, a set of 

of the value of the function given by (3) computed for each classics CDs, and a set of modern classical music CDs. Each 

'shortest' path. of these sub-categories of classical music may again be 

Alternatively, the value of function (3) may be computed subdivided further. 

for each path in the graph, from a given user to any other 2Q Once a category of items is identified, a computer system 

user (who rated a given item), having less than a predeter- may be queried to provide a user with recommendations for 

mined number of edges. A weighted average of the value(s) items which a given user has not rated, and which the given 

of function (3) associated with each of these paths may serve user is predicted to like the most (provide a relatively high 

as the predicted rating of the given item by the given user. rating for) or the least (provide a relatively low rating for). 

TT . . „ , ... „ , . tc An "extreme" query may be characterized as a query for 

Updating a Predictability Relation 2i u- u ■ • j- . j * * i?- t_/i \ 

r & J items which a given user is predicted to rate high(low) 

A data structure may be maintained in order to store a compared with prediction for ratings by the given user of 

graph of a predictability relation. The data structure of the other items. 

predictability graph may store the nodes associated with FIGS. 6A and 6B illustrate a method for responding to an 

users, as well as the edges connecting between nodes based 30 "extreme" query for items in a particular category. Suppose 

on the predictability relation. Additional information may be a given user is provided along with a given set of items in 

stored in the data structure. For example, as each node is a category, denoted CAT. In step 602 a choice may be made 

associated with a user, ratings provided by a user, and whether to seek a highest rating prediction or a lowest rating 

predicted ratings previously computed for a user may also be prediction for the given user. If a highest rating prediction is 

stored with the node associated with the user. In addition, 35 sought in step 602, then in step 604 the variable BEST_RAT 

predictor values associated with an edge in the graph may be may be set to 'inf *. If a lowest rating prediction is sought in 

stored with the edge. Optionally, a data structure may be step 602, then in step 606 the variable BEST_RAT may be 

maintained for a horting relation. If a data structure is set to 0. In step 608 the variable J indexing a plurality of 

maintained for a horting relation, it may be useful to store items may be set to 1. In addition, in step 608 the variable 

the values D^i. h)> for eacn P air <s»t>, in addition to an 40 WINNER may be set to 0. The variable WINNER indicates 

edge connecting user i A with user i 2 . In this case predict- which item (if any) corresponds to either the highest or 

ability may be calculated "on-the-fly". lowest rating prediction for a given user. In step 610 a 

Updating a data structure for a predictability graph may determination may be made whether the given user has rated 

be necessary when a new user is added, or when an existing the 3 th item in the category CAT. If the user has already rated 

user modifies (adds or changes) his/her current ratings for an 45 the 1 th item, then in step 622 the variable J is incremented, 

item or item(s). Hence, when performing the steps of the If in step 610 it is determined that the given user has not 

method illustrated, for example, in FIG. 1, some computa- rated the J"* item, then in step 612 the variable VAL may be 

tions may be performed "on-the-fly". If a given user is new assigned the value of the predicted rating for the j f/l item in 

or if the given user modified his/her ratings, the edges the category CAT for the given user. Such a predicted rating 

originating from the node assigned to the given user in the 50 may be obtained, for example, by the method illustrated in 

graph, and related information (e.g. predictor values), may FIG. 1. 

be recomputed. If new users have not been added and Note that as the predictability relation may not necessarily 

existing user have not modified their ratings then a predicted be updated, it may not be necessary to repeat steps 102, 104, 

value may be calculated by performing steps 110 and 112 of 106, and 108 of FIG. 1 for every computation of a predicted 

the method illustrated in FIG. 1. 55 rating. A predicted rating may be computed by performing 



Queries 



steps 110 and 112 of FIG. 1. 

In step 614 a determination may be made, consistent with 
Using a method in accordance with an embodiment of the the determination made in step 602, whether the highest or 
present invention, a predicted rating, of a given item for a lowest rating prediction is sought for the given user. If a 
given user based on the ratings of other users, may be 60 lowest rating prediction is sought in steps 602 and 614, then 
calculated. The predicted rating calculated may be viewed as a determination may be made in step 616 whether the 
a response to a query, submitted to a computer system, for variable VAL is bigger than or equal to the variable BEST__ 
an estimate of the given user's rating of the given item. RAT. If a highest rating prediction is sought in steps 602 and 
Various other queries may also be answered by using the 614, then a determination may be made in step 618 whether 
calculation of a predicted rating as a building block. 65 the variable VAL is less than or equal to the variable 

Suppose that items rated by users are classified in a BEST_RAT. If in step 616, it is determined that VAL is 
category hierarchy or tree. In other words, the set of items strictly less than BEST_RAT, then in step 620 the variable 
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WINNER may be set to the j lA item in the category CAT, and For example, consider a customer interested in purchasing 

the variable BEST_RAT reset to VAL. If in step 616, it is classical music CDs. Suppose that the CDs have been 

determined that VAL is strictly greater than BEST_RAT, categorized as illustrated in FIG. 5. If the customer is, for 

then in step 620 the variable WINNER may be set to the J'* example, browsing Web pages concerning early music, then 

item in the category CAT, and the variable BEST_RAT reset 5 a me thod for responding to an "extreme" query, may be used 

to VAL. Thus, if in step 616 (step 618) the predicted rating t0 automatically predict which CD in the early music 

VAL, calculated in step 612, is found less than(greater than) cate g 0 ry the customer may rate highest. The CD predicted to 

i^™* 651 f ating BES ,Ti; R ^ ^ the Value ? f be rated highest by the customer may be recommended to 

BEST RAT may be reset to VAL before incrementing the ±c by, for example, embedding a banner adver- 

variable J in i step 622. In this manner it may be possible to ^ Web yiewed me ^ 

keep track of the item corresponding to the highest or lowest . c 4 . 4 u j i j * j h i ui i 

nredicted ratine if the customer had already rated all available early music 

If either in step 616 VAL is determined to be greater than CD *> 0f * no ( ratin f may be ^ T *" '7^' 

or equal to BEST RAT or in step 618 VAL is determined to to an ( ex f me ^ m ^ be automatically repeated for 

be less than or eq^ al to BEST_RAT, then in step 622 the £« P aren ! of ^s Any of the classical 

variable J may be incremented. In step 624 a determination 15 CDs Predicted to be rated highest by the customer may then 

may be made whether all items in the category CAT have be recommended to the customer. 

been considered. In other words, is the item index J less than Responses to other queries may also be deduced by 

or equal to the cardinality of the set of items comprising the building upon a method for predicting ratings, such as, for 

category CAT(catsize(CAT)). If all the items in the category example, the method illustrated in FIG. 1. For example, a 

CAT have been considered, i.e. if J>catsize(CAT), then in 20 "target" query may be characterized as a query for a list of 

step 626 a determination may be made whether the variable user s who are predicted to like (rate highly) a given item. 

Winner has the value 0. In other words, were any items Further, a list of users predicted to like a given item may be 

found, corresponding to highest or lowest ratings, in cat- prov ided in sorted order of ratings. That is, customers 

egory CAT. corresponding to higher ratings of the given item may 

Note that ratings vary between 1 and v. Hence, if the 25 appear at the top of the list. 

Winner=0, then in step 628 it is reported that no items were rir , , .,, 4 , iL , f „ 4 

found. On the other hand, if Winner-0, then in step 626 the " 7 1 " ustr f 65 a m f l hod for re f° ndin g to \ tar S et 

item (Winner), having the highest or lowest rating, is query for a list of users who are predicted to rate a given item 

reported as well as the corresponding predicted rating higher than other users. Suppose that a total of Nuser users 

(BEST_RAT). For example, if all the items in the category 30 are involved in a collaborative filtering application. Let 

CAT have been rated by the given user, then Winner may LENGTH be the length of the list of users sought. In the 

retain the value 0 throughout the process illustrated in FIG. exemplary process illustrated in FIG. 7 two lists may be 

6, and no items corresponding to (highest or lowest) pre- maintained: RATS[], a list of predicted ratings; and USER 

dieted ratings may be found. N a list of corresponding users. In step 702 the (LENGTH) 

If in step 624 the index J is less than catsizetCAI) (the 35 entrie u s , °f a . 1 m W initiaUzed to 0, and the 

number of item in the category CAT) then the sub-process ^ mable Uy^xmg users, may be set to 1. In step 704 a 

comprising the steps 610, 612, 614, 616, 618, 620, 622, 624 determmation may be made whether the I* user has rated the 

may be repeated. In other words, assuming the given user 8 lven ' (™)- If me \ ™* ra * d 11,6 given ^m then 

has not rated the (J+l)" 1 item, the predicted rating associated m ste P. 726 1 » incremented. If the I user has not rated the 

with the (J+l)'* item in the category CAT may be compared 40 ^"m, then . m step 706 a predicated rating (VAL= 

with the current predicted rating BEST_RAT. PRATING(I,ITEM)) of the g,ven .tem by the I* user may be 

r\ 11 nroT hat u lL , , , calculated. Such a predicted rating may be obtained, for 

Optionally, BEST RAT may be set to an upper threshold « , iL X. j ■« . j ■ * t jj- • • 

• * j ri_ • * *~~ <• 0 - * a\A o n at example, by the method illustrated in FIG. 1. In addition, m 
instead of bemg set to inf instep 604. Setting BEST_RAT , J , U1 T , _ TT , KT ™ T . 

* ^ u i a • # cXa u ste P 706 a variable J may be set to LENGTH+1. 
to an upper threshold in step 604 causes any items corre- r J 

sponding to predicted ratings with value less than the upper 45 Note that as the predictability relation may not necessarily 

threshold to be considered as a candidate for lowest pre- be updated, it may not be necessary to repeat steps 102, 104, 

dieted rating. Further, BEST_RAT may be set to a lower 106 > and 108 of FIG - 1 for evei 7 computation of a predicted 

threshold instead of being set to 0 in step 606. Setting rating. A predicted rating may be computed by performing 

BEST_RAT to a lower threshold in step 606 causes any ste P s 110 ^ 112 of 1 

items corresponding to predicted ratings with value greater 50 In step 708 a determination may be made whether the 

than the lower threshold to be considered as a candidate for predicted rating VAL calculated in step 706 is less than the 

highest predicted rating. (J-1)" 1 entry in the list RATS[ ], namely RATS[J-1]. If in 

A method for responding to an "extreme" query, such as, ste P 708 il >s determined that VAL<RATS[J-1], then the 

for example, the process illustrated in FIG. 6 may have process of FIG. 7 may proceed to step 714. If in step 708 it 

applications in electronic commerce or e-commerce. 55 & determined that VAL is greater or equal to RATS[J-1], 

e-commerce refers to the process of trading goods and mea m ste P 710 J may be decremented. In step 712 a 

commodities by electronic means, for example, purchases determination may be made whether J>1. If J is determined 

made over the Internet. The increasing popularity of the t0 be greater than 1, then the process may proceed to step 

Internet has made e-commerce applications of commercial 708. If J is determined to be less than or equal to 1, then in 

importance. In particular, a method such as, for example, the 60 ste P 714 a determination is made whether J-LENGTH+1. If 

process illustrated in FIG. 6 for responding to an "extreme" J is determined in step 714 to be LENGTH+1, the I may be 

query, may be used to make recommendations to users in incremented in step 726. Note that steps 708, 710, 712, and 

e-commerce applications. It may be desirable, for example 714, utilize the variable J (a list positioning index) to 

for marketing purposes, to predict the types of products indicate the magnitude of the predicted rating VAL as 

which may be (most or least) preferred by a customer. The 65 compared with the ratings stored in the list RATS[*]. 

predicted (preferred) items may be provided to a target If it is determined in step 714 that J*LENGTH+1, then in 

customer. step 716 the variable k may be set to LENGTH. Note that if 
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at step 714 it is determined that J^LENGTH+1, then the Implicit and Explicit Ratings 

value VAL and user I may be inserted into the lists RATSP1 „ t r . 

and USER[],respectively, at the position indicated by J. Ratl , n 8 s u ma y be c ° llecled ,. dlrectl y fr , om user !i. f ° r 

Thus, in step 718 the values of k and J are compared. If it « xam P ,e > ™* ns of a ^ T"^. ( °, 0? T 

is determined in step 718 that k-J, then in step 724 RATSfk] 5 Ratm 8f n«y. however, opttonally be collected .mphctly for 

may be set to VAL, and USERpc] may be set to I. If in step b * trackm S a user 11 s act ">°? ln . a """P"^ s y stem - 

718 it is determined that k*J, then in step 720 RATS[k] may ^phcit ratmgs may be coUected for instance, by using a 

be set to RATS[k-l], and USERpc] may be set to USER weighted keyword frequency attribution analysis ; of 

[k-1]. In step 722 k may be decremented, i.e. k is reset to b ™* d Web P a S es and/br of ^ ct ™* made Web 

k-1. From step 722 the process may proceed to step 718. 10 P a S es - 

From step 724 the process of FIG. 7 may proceed to step Exemplary Computer Apparatus 
726 in which I may be incremented. In step 728 a determi- 
nation may be made whether all users involved were FIG 8 * a block diagram of an apparatus for predicting 
considered, i.e. a determination is made whether I>Nuser. If a ratin S> which corresponds to an item and which is asso- 
I is greater than Nuser, then all user have been considered. 15 ciated with a user, over a computer network. In the embodi- 
If I is greater than Nuser, then in step 730 all nonzero entries mem depicted in FIG. 8, multiple client computers 802 may 
RATS[m] and USER[m], m-1, . . . , LENGTH, may be access a se™ 806 » for example a Web server, over a 
reported. The nonzero entries in the list RATS[] are pre- network 804. Server 806 may have a memory 810 as well as 
dieted ratings (in non-increasing order) of the given item for a cache 808 • ^ ma y farthcr include a Central 
the corresponding users in the list USERQ If I is less then 20 Processing Unit (CPU) 812 for processing information, and 
or equal to Nuser, then from step 728 the process may a disk 814 for storin S data * Ratin S s ma y be coUected 
proceed to step 704, i.e. the (I+l)" 1 user may be considered. (implicitly or explicitly) from client computers 802 by 
Therefore, when the process illustrated in FIG. 7 terminates 806 over network 804. Clients 802 may also query 
the list RATS[] may include (in decreasing order) predicted s ^ vtT 806 regarding the information stored in data memory 
ratings of the given item for the corresponding users in 25 810 and disk 814. In particular, a client computer may 
USER[ ]. Further, the list of users produced by the process su PP!y server 806 Wlth a & yGn user and a g iven item - Server 
illustrated in FIG. 7 may be a list of users who are predicted 806 ma y compute a projected rating of the given item for the 
to like the given item more than the other users. S iven ^ based on the information stored in a database on 

As in the case of an "extreme" query a "target" query may d ^ 814 and in mGm ^ 81 °* Scrver 806 ma y re P° rt the 

have e-commerce applications. For example, consider the 30 P redicted ratlD S t0 a cheDt «H»puter. 

case in which for marketing purposes a company may wish Although illustrated and described herein with reference 

to develop a list of customers or potential customers who are 10 certain exemplary embodiments, the present invention is 

predicted to like a given product. A music CD distributor nevertheless not intended to be limited to the details shown, 

may, for instance, wish to obtain a list of customers which Rather, various modifications may be made in the details 

are predicted to like a given recording. A "target" query may 35 witnin the scope and range of equivalents of the claims and 

help to provide a list of customers who are predicted to without departing from the spirit of the invention, 

appreciate the given recording. What is claimed: 

Responses to other queries may also be deduced by 1. A method for predicting a rating of a plurality of ratings 

building upon a method for predicting ratings, such as, for associated with a user of a plurality of users, the rating 

example, the method illustrated in FIG. 1. As noted above 40 corresponding to an item of a plurality of items, said method 

with respect to an "extreme" and a "target" query other comprising the steps ot: 

queries may also have e-commerce applications. Some (a) providing, for each of the plurality of users, one of the 

exemplary queries are given in the following: plurality of ratings corresponding to at least one of the 

1. What is the predicted rating of a given item for a given plurality of items; 

user ? (b) calculating a predictability relation between ones of 

2. Produce a list of users who have rated the most items the P luralit y of users and otber of the P luralit y of 
in common with a given user (these items may be ™ GTS based 0D the result of ste P ( a )i 

restricted to a given category). ( c ) assigning one of a plurality of nodes to each of the 

3. Produce a list of users with whom the ratings of a given 50 plurality of users; 

user are most similar (this comparison may be made by ( d ) connecting ones of the plurality of nodes with other 

restricting ratings to items in a given category). ones of the plurality of nodes by a plurality of edges 

4. Produce a list of users with whom the ratings of a given based on the predictability relation; 

user are least similar (this comparison may be made by (e) searching a graph which includes the plurality of 

restricting ratings to items in a given category). 55 nodes and the plurality of edges for a path from a node 

In addition similar techniques to those employed for assigned to the user of the plurality of users to an other 

producing responses to queries may be applied in order to node assigned to an other user of the plurality of users; 

provide users with personalized recommendations. For and 

example, upon entering a computer system a user may be (f) calculating the rating of the plurality of ratings asso- 

presented with a promotional list of items based on predicted 60 ciated with the user of the plurality of users based on 

ratings. Further, real-time recommendations of items may be the path and the predictability relation, 

made to a user based on items the user just purchased or 2. The method of claim 1, wherein the plurality of users 

inquired about. Real-time advertisements may selected and are a plurality of customers, the plurality of items represent 

shown to a user viewing a Web page. For example, if a user a plurality of products for sale, and the plurality of ratings 

searches the Internet for information regarding a jazz music 65 are an indication of satisfaction of a customer of the plurality 

CD, then advertisements for other music CDs that the user of customers with a product of sale of the plurality of 

is predicted to tike may be displayed to the user. products for sale. 
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3. The method of claim 1, wherein step (e) includes 
searching the graph for a shortest path from the node to the 
other node, the other user having provided any of the 
plurality of ratings corresponding to the item. 

4. The method of claim 1, wherein the path from the node 5 
to the other node searched for in step (e) includes less than 

a predetermined number of edges. 

5. The method of claim 1, wherein step (b) includes 
determining a plurality of transformations of ratings corre- 
sponding to the predictability relation based on the result of 10 
step (a). 

6. The method of claim 5, wherein step (b) further 
includes determining a plurality of prediction values, each of 
the plurality of prediction values associated with one of the 
plurality of transformations of ratings. 15 

7. The method of claim 6, wherein step (f) includes the 
steps of: 

composing ones of the plurality of transformations of 

ratings based on the path, and 
calculating the rating based on the composition of the 20 

ones of the plurality of transformations and ones of the 

plurality of prediction values associated with the ones 

of the plurality of transformations. 

8. The method of claim 1, further comprising the steps of: 
partitioning the plurality of items into a plurality of 

categories; 

selecting a category of the plurality of categories; 

repeating steps (e) and (f) to calculate a respective rating 
corresponding to each respective item of the category, 30 
the respective rating associated with the user; and 

sorting the respective items of the category according to 
the corresponding respective ratings. 

9. The method of claim 1, further comprising the steps of: 
partitioning the plurality of items into a plurality of 35 

categories; 

selecting a category of the plurality of categories; 

repeating steps (e) and (f) to calculate a respective rating 
corresponding to each respective item of the category, 40 
the respective rating associated with the user; and ' 

reporting a preferred item of the plurality of items corre- 
sponding to a highest rating of the respective ratings of 
each respective item of the category. 

10. The method of claim 1, further comprising the steps 45 

of: 

partitioning the plurality of items into a plurality of 
categories; 

selecting a category of the plurality of categories; 

repeating steps (e) and (f) to calculate a respective rating 
corresponding to each respective item of the category, 
the respective rating associated with the user; and 

reporting a rejected item of the plurality of items corre- 
sponding to a lowest rating of the respective ratings of 55 
each respective item of the category. 

11. The method of claim 1, further comprising the steps 

of: 

repeating steps (e) and (f) to calculate a respective rating 
associated with each respective user of the plurality of 60 
users, the respective rating corresponding to the item; 
and 

sorting the respective users according to the respective 
ratings associated with each respective user. 

12. An e-commerce method for producing a predicted 65 
rating of a plurality of ratings indicating a level of satisfac- 
tion of a given customer of a plurality of customers, the 
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predicted rating corresponding to a product of a plurality of 
products for sale, said method comprising the steps of: 

(a) providing, for each of the plurality of customers, one 
of the plurality of ratings corresponding to at least one 
of the plurality of products for sale; 

(b) calculating a predictability relation between ones of 
the plurality of customers and other ones of the plu- 
rality of customers based on the result of step (a); 

(c) assigning one of a plurality of nodes to each of the 
plurality of customers; 

(e) connecting ones of the plurality of nodes with other 
ones of the plurality of nodes by a plurality of edges 
based on the predictability relation; 

(f) searching a graph which includes the plurality of nodes 
and the plurality of edges for a path from a node 
assigned to the given customer of the plurality of 
customers to an other node assigned to an other cus- 
tomer of the plurality of customers which provided a 
rating of the plurality of ratings corresponding to the 
product; and 

(g) calculating the predicted rating associated with the 
customer based on the path and the rating provided by 
the other customer. 

13. The e-commerce method of claim 12, further com- 
prising the steps of: 

partitioning the plurality of products for sale into a 
plurality of categories; 

selecting a category of the plurality of categories; 

repeating steps (f) and (g) to calculate a respective pre- 
dicted rating corresponding to each respective product 
for sale of the category, the respective predicted rating 
associated with the given customer; and 

sorting the products for sale of the category according to 
the corresponding respective predicted ratings. 

14. The e-commerce method of claim 12, further com- 
prising the steps of: 

repeating steps (f) and (g) to calculate a respective pre- 
dicted rating associated with each respective given 
customer of the plurality of customers, the respective 
predicted rating corresponding to the product for sale; 
and 

sorting the respective given customers according to the 
respective predicted ratings associated with each 
respective given customer. 

15. An article of manufacture comprising a computer 
usable medium having computer readable program code 
means embodied therein for predicting a rating of a plurality 
of ratings associated with a user of a plurality of users, the 
rating corresponding to an item of a plurality of items, the 
computer readable program code means in said article of 
manufacture comprising computer readable program code 
means for causing a computer to effect: 

(a) providing, for each of the plurality of users, one of the 
plurality of ratings corresponding to at least one of the 
plurality of items; 

(b) calculating a predictability relation between ones of 
the plurality of users and other ones of the plurality of 
users based on the result of step (a); 

(c) assigning one of a plurality of nodes to each of the 
plurality of users; 

(d) connecting ones of the plurality of nodes with other 
ones of the plurality of nodes by a plurality of edges 
based on the predictability relation; 

(e) searching a graph which includes the plurality of 
nodes and the plurality of edges for a path from a node 
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assigned to the user of the plurality of users to an other 
node assigned to an other user of the plurality of users; 
and 

(f) calculating the rating of the plurality of ratings asso- 
ciated with the user of the plurality of users based on 
the path and the predictability relation. 

16. An article of manufacture comprising a computer 
usable medium having computer readable program code 
means embodied therein for producing a predicted rating of 
a plurality of ratings indicating a level of satisfaction of a 
given customer of a plurality of customers, the predicted 
rating corresponding to a product of a plurality of products 
for sale, the computer readable program code means in said 
article of manufacture comprising computer readable pro- 
gram code means for causing a computer to effect: 

(a) providing, for each of the plurality of customers, one 
of the plurality of ratings corresponding to at least one 
of the plurality of products for sale; 

(b) calculating a predictability relation between ones of 
the plurality of customers and other ones of the plu- 
rality of customers based on the result of step (a); 

(c) assigning one of a plurality of nodes to each of the 
plurality of customers; 

(e) connecting ones of the plurality of nodes with other 
ones of the plurality of nodes by a plurality of edges 
based on the predictability relation; 

(f) searching a graph which includes the plurality of nodes 
and the plurality of edges for a path from a node 
assigned to the given customer of the plurality of 
customers to an other node assigned to an other cus- 
tomer of the plurality of customers which provided a 
rating of the plurality of ratings corresponding to the 
product; and 

(g) calculating the predicted rating associated with the 
customer based on the path and the rating provided by 
the other customer. 

17. An article of manufacture as recited in claim 16, the 
computer readable program code means in said article of 
manufacture further comprising computer readable program 
code means for causing a computer to effect: 

partitioning the plurality of products for sale into a 
plurality of categories; 

selecting a category of the plurality of categories; 

repeating steps (f) and (g) to calculate a respective pre- 
dicted rating corresponding to each respective product 
for sale of the category, the respective predicted rating 
associated with the given customer; and 

sorting the products for sale of the category according to 
the corresponding respective predicted ratings. 

18. An article of manufacture as recited in claim 16, the 
computer readable program code means in said article of 
manufacture further comprising computer readable program 
code means for causing a computer to effect: 

repeating steps (f) and (g) to calculate a respective pre- 
dicted rating associated with each respective given 
customer of the plurality of customers, the respective 
predicted rating corresponding to the product for sale; 
and 

sorting the respective given customers according to the 
respective predicted ratings associated with each 
respective given customer. 

19. A storage device readable by machine, tangibly 
embodying a program of instructions executable by the 
machine to perform method steps for predicting a rating of 
a plurality of ratings associated with a user of a plurality of 
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users, the rating corresponding to an item of a plurality of 
items, said method comprising the steps of: 

(a) providing, for each of the plurality of users, one of the 
plurality of ratings corresponding to at least one of the 
plurality of items; 

(b) calculating a predictability relation between ones of 
the plurality of users and other ones of the plurality of 
users based on the result of step (a); 

10 (c) assigning one of a plurality of nodes to each of the 
plurality of users; 

(d) connecting ones of the plurality of nodes with other 
ones of the plurality of nodes by a plurality of edges 

15 based on the predictability relation; 

(e) searching a graph which includes the plurality of 
nodes and the plurality of edges for a path from a node 
assigned to the user of the plurality of users to an other 
node assigned to an other user of the plurality of users; 
and 

(f) calculating the rating of the plurality of ratings asso- 
ciated with the user of the plurality of users based on 
the path and the predictability relation. 

25 20. A storage device readable by machine, tangibly 
embodying a program of instructions executable by the 
machine to perform method steps for producing a predicted 
rating of a plurality of ratings indicating a level of satisfac- 

3Q tion of a given customer of a plurality of customers, the 
predicted rating corresponding to a product of a plurality of 
products for sale, said method comprising the steps of: 

(a) providing, for each of the plurality of customers, one 
of the plurality of ratings corresponding to at least one 

35 of the plurality of products for sale; 

(b) calculating a predictability relation between ones of 
the plurality of customers and other ones of the plu- 
rality of customers based on the result of step (a); 

(c) assigning one of a plurality of nodes to each of the 
plurality of customers; 

(e) connecting ones of the plurality of nodes with other 
ones of the plurality of nodes by a plurality of edges 
based on the predictability relation; 
45 (f) searching a graph which includes the plurality of nodes 
and the plurality of edges for a path from a node 
assigned to the given customer of the plurality of 
customers to an other node assigned to an other cus- 
tomer of the plurality of customers which provided a 
rating of the plurality of ratings corresponding to the 
product; and 

(g) calculating the predicted rating associated with the 
customer based on the path and the rating provided by 

55 the other customer. 

21. The storage device as recited in claim 20, the program 
of instructions tangibly embodied in said storage device 
further comprising instructions to perform method steps 
executable by the machine of: 
60 partitioning the plurality of products for sale into a 
plurality of categories; 
selecting a category of the plurality of categories; 
repeating steps (f) and (g) to calculate a respective pre- 
65 dieted rating corresponding to each respective product 
for sale of the category, the respective predicted rating 
associated with the given customer; and 
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sorting the products for sale of the category according to 

the corresponding respective predicted ratings. 
22. The storage device as recited in claim 20, the program 
of instructions tangibly embodied in said storage device 
further comprising instructions to perform method steps 
executable by the machine of: 

repeating steps (f) and (g) to calculate a respective pre- 
dicted rating associated with each respective given 
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customer of the plurality of customers, the respective 
predicted rating corresponding to the product for sale; 
and 

sorting the respective given customers according to the 
respective predicted ratings associated with each 
respective given customer. 
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